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(54) Smg^feiS S?s?er1eav!n§, a family oS systematic ifitesieavers atid <SeSmerSeavers 

(57) A^spatatus that reaiizes a siibstapiliat advan- 
tage by errpioying Imsjiisd inlesleawng lo create a sys- ki j ^ 
lemaiic iniecSeaver, that can result in a superior biock r iis-. 1 U 
etTor rate compared to the cutrsnt data interSeaifisig 
techniques in wfiich urx;onect«!ci error bursts aredisirib- 
uted by the dsinterieaver. The disdosad fM-inciples lead 
to a emtKxSiinents ?ha! essefitiaJSy eliminate transmitter 
memory regardless o( the interleaving approach 
employee. Sy way o! exampie, block interleaving (regu- 
Ear or rar?dOTi), ccsrwoluiionai tmerl saving (re^juiar arxj 
jarKiom) arsa product inlerleas/ing approaches are 
described, in ir^ipliea interleaving, all irrcoming dala is 
treated as if it is pre-irrterleaved anci transmitted directly 
to its desiii^ation witiiowi atteratior! to its sequence, arid 
essentia!; without delay. Concurrarttly wjittt the frans- 
rriission cf the data, She data is applied tc apparatus ttiai 
trests the data as !? it had been inierieaved in accord- 
artce with a selected interleaving approach and. in 
accordance witti such treatment, redundant symbois 
are generated ar»d inserted into Ihe transmitted data 
stream. At the feceivrer the incoming data is delayed, 
corrected, and the intormalion synnbcte in the incoming 
data are cSelivered so the user, corrected as necessary, 
in the s&me orcsar as the informatiofi symbols arrived at 
the recesver. 





2,13 9/3 4 




5 This invention relates to systemafic intsrSsavers ard deioterieavers that are us«j in conjunction with eiror cosrect- 

j tig coders, 

COfnmur^ication signals iwariabiy must deal witti transmissiofi of signals tfirough noisy channels where errors 
are introduced. F!G. 1 presents the btocK diagrarn of a fasrsy sophisScated prior art arrangemsit for such an erwiron- 
mem. vriier e data is f irsf appiied to encoder i oc, the encoded data is passed on to irrterleaver 200. the interleaved data 
JO is modulaisd in fc^ock 300 and the modutaled data is appfied to the channel. The signal provided by the diannel is 
demodulated in tjtock 400. deanterleaved in b!oc3^ 500 artd decoded in tsiock 600. 

Sntsrieaver 200 is interposed in the sysJem in order to account for burst errors in the cfwr^nel. SpecHicaHy, inter- 
ieaver 200 disperses adjacent signal eier^ients in ^me prior to modulation, that tDurst errors do not affect too many adja- 
cent sigrtal elements oi the originat uninterlaaved signal. Conversely, when considering tlie signal comitig from tiis 
?s charsrtei, errors that afs closely ^>aced in time are interspersed at the output and are. therefore, far apart from each 
other. Ttie corisaquen>ce of this dispersing is that decoder 600 is able to recover the data entered into encoder 100 by 
virtue of the error-corrscting redundancy inciudsd id the signjj which decoder 600 utilizes. 

As ts wetl known. rrioduSator 300 and demodLflator 4C0 may tie sut>sysSems that therrselves include nofcijst coding 
and decoding. For exannple. modulator 300 may include a front erid section that is a trellis encoder, Ckjrrespondirsgly, 
s-3 the tail-end of demodLiiaSor 400 would include a Viterbi decoder. 

A subs!ari6ai sdvsntage is realized ir^ accordance with the principles disclosed herein by enrplcyir^ irrp!i©d inter- 

ss laavifig- An infiplierf interleaver is s sysiemaiic interleaver. which is one that does not alter the incoming data sequence, 
and ss such may resuSt in a superior block error rate, compared to Sie current data imerleaving techniques in »ihid> 
uncorrected ei tor tiursts are distrSxjted by the deinterleave.^ 

While in other interieavip^g and encoding approaches ttia encodirig apparatus requires memory and irriposes delay 
upon some of tfie tra.nsmrtted signal, ifT53fied interieawng essentially dispenses with all memory arxt corresponding 

30 de-ay in the transmStef-srecoder By way ot esample, block intcrteaving, ccjnvolutionat interleaving, random and product 
tnterieaving approaches are described. The only memory that is needed is the one which is nprrnaliy provided tor the 
speed-up in the data rate to create room for the insertion of reduridant symbds in the transmitted data stream. Concur- 
rently with its transmission, the data is aji^ied to apparatus that tr eats the data as S it had been interleaved in accord- 
ance witti a selected tntsrleaving approach. !n accordance wim such traatment, redundam symbds are genarsted and 

35 Inserted into tt»e tranamstted data stream. 

At the receiver, the incoming data is delayed, corrected, and tfie infof mation symbols in the iricorrting data are deliv- 
ered to the user, ccrreded as necessary, in the same order as the inforrrjation synntiols an-ived a! the receiver. Sir»ce 
the data sequence is rsct chanEjed at the receiver, the decoder can operate on the data direcSfy inside the deinter leaving 
memory The errors are eierefore correcsed in-place, without the need tor mutlipis data storage at the decoder input and 

40 ouiput stages. 

Brief Descripttgrt g ^ t^e Drawing 

FiG. 1 shows a pr:Cf art coder/decoder arrangement with an interleawer arK) a d ei n Eerl ea ver-in!ef leaver interposed 
45 therebetween; 

FIG, 2 illustrates block interleaving: 

FIG. 3 presents s memory map arranged for bJock interleaving; 
FIG. 4 illustrates convolutionai interleaving; 

FIG. S presets s memory map for a conwiutiona) code where codewords are of length 1 1 and the interleaving 
ss depth is S; 

FIG. 6 presents & memory map for a convoliitional code where codewonSs are of length 1 1 and ih© inferteavir^g 
depth is 7; 

FIGS. 7-9 corresporid to FIGS, 3. 5. and 6. with the redursdanl symbtsis shawn: 
FfG. 10 is a iDlock -SiagrarT^ of one realiiattcn of an encoder tollOiAfing the principles disclosed herein: 
S5 FiGS. 11 -12 are other embodiments of the principles disclosed herein: 

FIG. 13 is a black diagram of a receiver suitable 1br encoder arrangement of FIG. 10, and it is a^so a deplcttoo of 

the Riost compact transmitter; 

FiG. 14 presents & memory rnap fa*" product encoding; 

FiG. 1 S is an encoder arrangement for the FIG. 14 produd code: and 
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F!G. t6 itl6;stra!es random corwotutionaS imerieaving. 



tmerieavmg a-gorithns and tecfiniques were introduced io !he art of communicafon in order to increase the noise 
i mmuniEy o5 systems that are siibjecl to bursE errors. Inierleaving algorithms define the relaiions arrong data sequences 
of different codeword biocks 01 the {ransmission chanriel. and interleaving techniques deJine the impiememation meth- 
ods to acrti we these relations. Exarr^ies oi interteawng algorithms are t^ock jrjterleaving. and convofutiorsaf intertsav- 
tng. Examples of interleaving techniques, are data interseavirtg and code interieaving. 

In data inlsneaying. jnfcrmation is (irst applied to an encoder, and Itie encoder's OLrtpul is interleaved In coo-" 
interleaving (a rarely used technique), th© intormation Is tr^erfeaved first ajxi then applied to the encoding process This 
tedinsque is described by R. G. GaJlagsr in "Snfornrtation Theory artd Rsliabfe Comriiunfi^tlon-, John 'Wiley & Sons 
^968, w 286 et seq <FiG. 2) Gallager presets an Interlaced mterleayifig in a tjlock interJeaved arfangement where 
the incoming inlomiation are gated to multiple encoders. The Irrteriacsd InterSeavtng approach is an exampSe of code 
ifilerleavins where the irtformation is interieaved first and then encoded. Gailager eir^ioys a plurality of encoders in 
effect, he deintarleaves ttie informafion, routes the deinJerleaved Irtforntation to Ihe encoders, and then re-interieaves 
the information and the redundant symbols. He has apparenby not reatlKed that data can be viewed a being pre-if^ter- 



An uncsersiandir>s of interieaving algorithms can be gained by lookinfi a! the moyement of data syrrtbois in the time 
m domain, as shown tor exam?i'e in FiG. 2, or by viewing the process of storing data in a mat-is in acoordartce with one 
procedure and .'strieviog it tr. sccordarfce with another procedure, as sHown for example in FIG. 3. Both FIGS 2 and 3 
iilustrate block interleaving^ 

In block interleaving, a biock of data is reairanged to insure that consecutive symbols in the block prior to interleav- 
ing are not adjacent in the biock after the interieaving dear characteristic of block interleaving is that tne iPterleaved 
-m data can be separated into blocks of consecutive sytribols which coiresporxf to blocks aS consecutive symbois in the 
uninterleavad data, Jh^ only differet^ce between the two eon-esponding blocks is in the sequence of syrtibols in the 
blocks. 

For illustrative purposes. FIG. 2 depicts two biod«: of data, 1 0 1 and 1 02, each having M^D symbols More particu- 
lariy. each block includes D groups (codewords) o* N symbols each, ^nce block interleaving rearranges the sequence 

30 of symbols, ft « clear ttvat a defay must be introduced in order to allow later arriving symbols to a^oear eariigr in the 
interleaved output To a first degree of approximation, in biock encoding, the interleaved data of each block can be 
Obtained only after the entire olock of data has arrived. This is deleted by biocte 103 and 104 in FIG. £ which corre- 
spond to the interleaved data of blocte tOl and 102, respectively. The interleaving of data is acconplished fc^ taking 
consecutive symbois of each codeword, md dispersing thenn at intervals of 0 syiTtbols in blocks 1 03 and 1 04 (the value 

35 of D being the interleaving depth). Thus, the 1 st symbol o! the first codeword in block 1 0 1 (line 1 1 1 ) becomes the 1 s! 
symbol of codeword 10S, the 3nd symbol Of the first codevt<ord of bSock 101 {line 1 12) is moved to be the <D^-1}* symbol 
cl codesmrd 103, the thiid symbol of the first codeword of block 101 (line 113) is moved to be the C2D+i)>^' symbol of 
codeword 103, etc. 

In the same interleaving procedure, but viewed another way, ihe first symbol of the Isi codeword in block 102 (line 
114) become ;.ne Jirsi sy.-nboS of codeword 1 04. tie first symbol of the 2nd codeword in block 1 02 (line n 5) is nraved 
to be the 2nd symbi^ of codeword 1 04, etC; 

H the data of b-'ock 1 01 is written into successive ceiis of a storage element, then the above -tiescribed interleaving 
can be reaiisKJ fcjy .dimply reading data out in jumps of D ceils. If the storage element is viewed as a matria as depicted 
;n FIG. 3. and data is written into the matrix a column at a time, where each column contains a number of celts equal to 
-is ihe number of symjjois sn a codeword, then each codewrord occupies a column (see shaded area in the first cx^vmn) 
ar^d the above-<jescfibed intertsaving is realized by reading data out of the matrix, a row at a time. 

As indicated above, the interleaving described in connection with FIGS. 2 and 3 is biock interleaving w^re one 
can ider^tify a bSock 0! input data and a corresponding bJock of output dala. The output Wock contains only snedata of 
Jhe input biock. 

so In conTOlutsonaJ interleaving, no output block of ccmiguous data signals can be found ttiat corresponds to an input 

biock o! data, in the sense of comainrng only the data of the input bfock. 

A convoMiona! interleaving arrangerreot is depicted in FIG. 4, where the codeword lengt.h, N, is n symbols and 

the interleaving depth, D, is 5, It may be said tlial input block 105 supplies data to an interleaved output symbtrf 

sequence 1 05 of length N«D. but it supplies only some of the symbols for sequence 1 0S. and it also supplies data to a 
ss mamm symbol sequence The ialter data is iliusiratsd by the 20 (short) up-arrows in block f OS. Correspondingiy 

sequence 106 rece.ves synnfaols from ttie block tftat is previous fo biock 1G5. and that data is iliustrateci by the 20 (short) 

down-atrows in sequence 1 06, 

FIG. 5 IS a nratrix representation of the FIG, 4 interSeaving. and it contains it rows and 5 columns. Fcsliowing the 

teactiings of Aslsnis et ai in "A Selective Enor Conrection Propossi for ADSL', A^'SI Contribution TIEI .4/03-023. March 



8, 1 993, if the codewratis A through E of FIG. 4 are written in calumns as depicted in FIG. S, then data that is read out 
from the tnalris a rovv at a time yields the cowolirtionat interleaving of FIG. 4. More spectficaily, fof an arrangemefit 
where •^- '\ i arsd Di=S, if data ss written a Doiumn at a Sme. with each successive codeword being generally staggered 
by 2 rows jcodewjOfd 0 starting at row 0, artd each codeword i starting at row Si), then s straight reafiing-ojjt by rows 
5 results in an jnterleavsd outpift. 

A rturr*)er of attrsbtses should be noted m connection with the storage of cteta in a matrix, and the teaching of 
Astenis et a[. 

1 ) Asfanis et aS st.^ts that N arsd D be co-prime in oider for this arrangemeJit to srork: aithoisgh they recogni?e 
to tiia! when N and O are not co-prime dummy syrrtboSs can create a coprims r^asionsh^. However, the data at the 
tnterteaver output is NOT ontformiy distributed. One gets K*(N/D) ot symools wSh a spacing of D arid then one ge!s 
a syrrijo! with a spacing of D+1 (K is the largest common divisor). The total sy^em delay is inaeased by d;k sym- 
bols. 

2; Different sets cf N and D values will resuft in different staggering in row's and ccduntins, TliiiS, ftsr esampie, code- 
's woias that are atSi««:;it in t?'.«; mMi duXa sAnintr: rcxiy not J>f: ■!■! isdii-csint {.■sjiiifw-s ths; jvKsxrix . Tfas is iltustratsd in 
FiG. 6. *here l ard D=7. 

3; Astanis et ai believed that both block interleaving arvd corwoSutional interiesvtr^ require an interleaving memory 
0) M-vDsymbc^s- 

4} tfie convoiLKlortal interleaving described by /telanis et af arsd the associatesd storirjg of data in the matrix, 
so first syirFbol in ea<;h codeword experiences no deiay. The data is written and SUsn read-out imfnediatef jr thereafter. 
Other syrrijols. h<!wever, incur a delay that varies with the symbol position in the codewonS, On the receiver side 
the detntorlQSfvod: data is again deiayed by different amounts with the total delay being equa' across alJ data sym- 
bols, 

Etf-jctiveiy jgfs ^ClifSS!!3 delay can be ac^tswed t>y assuming that the data to be transmitted is actually the inter- 
leaved resuU of some other irr\agined data to which an interleaving algorithm had been applied. With such an assump- 
tiori. snx interleaving algorithm can be assumed lo have beai applied to this imagined data, with essentally no 
associated increase in the cort^tiexity ot the encoder or decoder. Staled in other words» if the data comes already inter- 
leaved, !he fmemaries into which the data is inserted in accordance with the d^icticns ot FIGS, 5 and 6 are noS rreeded, 
3d With the avaitaWs data already "interleaved", all that remains to be rime ss to encode *ie data and transmit it. Tbis 
leads to the tnrpiied inter;eaving concept, with its systematic characteristic, lor all types of interteaving algorithms not 
just biock interleaving. 

In applications where the encoding comprises merely the addhion of a rwrnber of redunttem. error correcting sym- 
bois/syrr-bols. a rate j»frvefsion must be executed to pro'^de the time sSots in whieb the rediFOdant synibols are kepi. 

35 and t^-^at requires some minimal amount of menfiory. The feduridant error correcting synixjSs are synrtbois (haS are asso- 
ciated with a group «:or;:5eci,*v;i 5;sii;si«; in She uni!^^^^t■S^^av■•■^:^ d>a:;3i. "!>!!;; fsier-Xisy is; r<;;! rTs;5iiy --usisijiscs ai i-ach er;c<xi<>r 
and distributed over the muitipie encoders. By combining all distriixrted smaii butters into a sirtgle one at the cJate> input, 
additiorsal reduction isi total rate conversion memory is achieved wrtiere the combined merrory can be as smalt as one 
of the small buffers at one of the encoder inputs. Effecliv^y reducing tf:e memof y by anomer factor 0. 

« It t^>e matrix arrangements of FIGS. 3, 5 ar^d 6 were viewed the with 2 error correcting symbols added to each code- 
word, the result woulci be as presented ir; FIGS. 7, S and 3. respectively, ti may be noted that with the particsjiar inter- 
leaving that was imphsd. ths positions of the codewords in columns of tlie matrices are different from those in FIGS. 3, 
5 afxi 6. The cells conaining numbers (1.2,3,4 and 5) designate the ceils wbsfe the codewords start, and the cioss- 
hatct^ed cells are the cells that contain the error correcting symbois. To reiterate, bcwever, when the data comes in 

4S already interleaved, ftnsii'jftfiief-w of FIGS. 7-9 as well as FIGS, 5-& do nai r^reseni needed memory, bul are 
shown merely to assist in undersianding the invention. 
Compared with Aslar^is et ai: 

) H and 0 can be of sr-y ratio and the data can be uniformly distrSxited, based only on desigoefs choice; 
so ?5 The staggering in rows arid columns lo different sets of N and D values and are the sols choice of tfje designer; 

3.; Both i:rfock inter! eavir?g arTd convoiutional interleaving require no tiansmit dSiay; 
4- Ai! symbols !n-;::uf a zero delay, regardless ot their pjosition in the cJDde word; ar?d 
5) Muiiiple chanr-.els with different encoders and interleaving deptti can be interleaved in tiie same circuit. 

ss Mofecvsr. there are rrsuSiple (Jncoder architectia-es that can be enployed within scope of the principles disdosed 
herein. One can havg an arcnitecture that is similar to that of Gaiiager {with appropriate added controllers), one can 
have an architecture that includes a biiffer at the common input, buffer in the data path and in the encoders, multiple 
buffets at the ir^ut to aiiow multipte channels, buffer at the output insiead of at the input or an architecture where all 
memory needs are n-et with a single RAW and an ALU with an associated controller. 
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A dsta trafi5T!!ts--:g trsoaule in accordance the principles disclosed herein is depidsd in flG. 10 with Reed 
So'omcm encoding. Specifically, FIG. 10 includes a sma!! FIFO buffer 220 wfhose output is trarismitted to channel 10 wia 
multipleifsr 221 . Ttis output of butter 220 is also applied to a router 222 which teeds & r>umber of RS (Reed Soicmon) 
encoders equal to the imerleaving depth, D. of which encodeirs 223, 224, 225 are shewn. The encoders deweiop error 

s correction syn^ois snd, at the appropriate timesi, those symtsds are transmrtted to channel 10 via router 226 and mu!- 
tipiexef 221. Bufter 220 provides the buffer nec^sary for rate converaon. The amourtt ot memory is dependent on the 
specifics of N and D. as well as on the nature of the assumed imerleaving aisorrfi^rn. Thus, for the Week interf^vtrig of 
FIG. 7. tor example, while the last two tows of the matrix (the error correcting syntoals) are applied to the communica- 
tion channel, aii "tnccmng data symbols must be tiuWered. While the 10 error correcting syrrtoote of she PtG. 7 arrange- 

,0 ment are applied to channel 1 0 (and sii forni a singJe urtinlerniptsd sequence when read cirt from the mairiK), there are 
(lO>'-55>/S5 symbols tfiat arrive which must be buffered. Hence buffer 220 requsres ten synrtiols of storage, in the con- 
volutionai interfeaving of FIGS. 8 and 9, on the other hand, the iongest sequence of error correcting symbcfs applied to 
cr^anne! 10 is 1 in FSG. 8 and Z in FIG. 9, Hence, buffer 220 requires only a minimal number of storase syn*ols, a single 
symbol cf storage or ma, re^ectrvely. Viewed another way, the buffer needs to contain enough information so. mat 

,S white symbols are inserted at one rats ard ejdracted at a higher rate, the bsjffer wilt ncrt fail to con^n symbols when 
symbols needs to be e«ract^. This leads to the relationship tt>at the buffer needs to b© as large as N{(To/T,)-l] raised 
to the ne^ti int&ger, -^^ere M is the iargest btoc!< of exti^cted symbols between redundarrt syntoois, and Tq and T, are 
tha oirtpwt and input ;^tes, respecSivety. 

Elements 222 end 226 are obwbusly affected by the interlsaving algorithm that is assumed to have been applied 

so to the "interteavec!" fiata. Mgitiptexer 221 needs to knew when the data symbols are communicated from buffer 220 and 
when tha error cosTBc:Snig symirols are communicated from combiner 226. and router 222 needs to know where to route 
the data symtoote, in accordance with the assumed, or jmplied. interteavihg. 

For essampie. tf it is assumed that the incomiitg data has been block iriterieaved in accordance with FiG, 7. the sym- 
bol corresponding to the ceil in the first raw arid the first column is designated to be the first symbol of the first codeword, 
and acccrdini^y. it is routed by element 222 to an RS encoder (e.g. , encoder 223) that had been reset immediately prior 
to the arrival of tfiat symbci; The next symbol, designated to be the first symtxil of the second codeword, is fOij&%d by 
element 222 to a secofid PS encoder (e.g., encoder 224) that had been reset immediately prior to the arrival of that 
symbol: ard the same treatment is applied to tfie remaining tfiree symbois. According to FIG. 7. after channel 10 
receJi/es 55 sysrsboSs from buffer 220 via mutepJexer 221 <aid at tliat time the same 55 symbols sre appliesd to RS 

30 encoders 223-225 via roiiier 222. the channel receives the nest 10 syrr^ls from the RS encoders via combiner 226 
and multiplexer 221 . -t may be noted in passing ttiat comtune.' 226 and multiplexer 22 f can be impiemented in a single 
combiner, but it is s=TOwn here as two dements to mate the description dearer. 

Sn figW of the atxjve esusn-ple, one can view the sequencing as being divkfed into two segments: a 55 symbol "data 
syrrttols" segmem ar^d & 10 symbol "error conecting symbols" segment. During the data symbols segmerjt router 222 

35 sequentially cycJes lh.fQugh 5 F!S encodere, ard during the first 5 eyndiols of the data segment each RS encoder to 
whioh (iaia is roiited is reset prior to the application of She data symt>o!. During the data symbds segment, multiplexer 
221 !S set to pass the data out of buffer 220 to channel 10, and the actions of contiinesr 226 are mefevant During the 
error correction symbois segment, no data is entered into the encoders by router 222, multipieixer 221 is set to pass the 
output signal of corr^iner 226 to channel 10. and combine 226 cydes twice f hrough the five RS erscoders and delivers 

40 their en-or encoding sjTntiols to channel 1 0. Data lh«jt arrives at that tsme is stored in bufter 220. 

The principle is tne sa.me for data that is assumed to have bean interleaved in accordance with the illustration in 
FIG. 8, but the speciJic sequencirsg is difterant. The table below iiiuslrates the actions in connection with the first 1 7 sym- 
bols for the arrangement, corresponding to FIG. 8. 

45 
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sym 
bol 


rmitsr221 


combine)- 226 










Sipp\y cSata to encoder 3 




3 


apply data to encoder 5 




4 




output error correciing symbcS ffosn erwoder 2 


5 


appiy data to ertccder 4 




6 


appSy cSaia to encxsder 1 




7 


apply data to sncoder 3 




8 


apply data to encoder 5 




9 




outpLjt error correcting syrnbo! from encoder 2 


10 


^f^lydal^ tQ €ncQd^r4 




11 

5:g 


appJy data to erscoder 1 








13 


ajpsy data to ertcoder 5 




14 


reiset encoder Z S appfy data to encoder 




15 


apfjly date !o encoder 4 




16 


appiy data to encoder 1 




17 




output error correcting symSxjJ frorn encoder 3 



tt may be noted tiiat the ceil where ericoder 2 is r«set is determinetS, for example, by designer's choice, by advarsc- 
ing 1 3 ceils (the ierigth of the codeword with the 2 error correcting syfft>o!s} Iram the point wtiere encoder l is reset, 
Tlie san^e appiies tor the resetting of all ottier erKXsders. 

.•?s The actual corrEiol is esercised by corrtroller block 250. The specrfic circuitry within block 250 (counters, shrft regis- 
?et5 and some combinatorial logic) is not presented here because ft is perfectly conventior>al and because it wi!i d^nd 
CHI the parttcular inter Seai/ing scheina that is impsied, or presumed. Tlie important thing to note, however, is that tiie FIG, 
10 arrangement is general enough to handle block intsfieav/ing, corivolulional irterteav<ir}g (as disclosed above) and 
product encodBig that could combine, for example, block interleaved arid cor»voluficna!ly interleaved data (as disclosed 

■■so below). 

The following presertts an arrangemerrt ot a impSsetJ conwoiutionai irsterteawing of codewords of l20-sym&c) tengtji 
and an interSeaving dspth of 30. 

C.ti,l l9. f-'m-l.lia- CmvE, 1 11, ... Cm ■ 2 9.7 ■ 
C^.l IB. !4- ^m-Z, 1 W- ■■- C;,„.ae,6- Cm.29,2> 

"^^ Cm 5)7, G„,., 1 53, Cni.2, ^QQ. •■■ Cm.gag, Crn.gH 1. 

Cm tie- Cfjj.i 1-S3, Cm-aj06' • ■ Cfn-SS.*- Cr, ?9,0. 
Crri.iiSvCm.i.m, Cm-a, 107^ -•. Cm.2e,3- Crn-1,119. 

Cm.i 14. Cfn-l.l iO' 106 ^m &S.Z- CmH,! 58. 

Cns.l la. -isjg, Cm-2. 105. ■■■ Cf^-gS.I. Cmfiji j-. 

C,^ , , g. G„,. , iQs, Cre,2. ) 04. - C„,.28_o. C^^f 116,.,. 

The signals of the fifst column are routed by siennent 222 So a first encodei- (223), the signals of the second colu.'nns 
are routed to a second encoder {224). and so on. Elements C^,j9 3 through C„>.£3,o are the redundancy syrribols. 
Wewed another way. each set of D cor>secu^ve symtrals is distr itK^ed arrjor^ D encoders, and every (D+l)'*' symbol is 
applied to tns same encoder. 

55 F!G. f -s presents a somewhat drfferertt encoder architecture, wSiere the memory of tJiiffer 220 is embedded in the 
encoders arid the data as w^l as the redundanS syrrfools are provided by the encoders It is shown tor the convoliitbna! 
anangament presait-3d above mih ^SO■&ynt^o\ codewords arsd an imerleaving depth of 30. PEG. 12 preserrts stifl 
another arcnitecture. where a separate buffer is used for the data patTi and the encoding path, aSkwing more complex 
encoding structure. 
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At the receiver end, (he arriving data can be- irfilizsd immedately, if desired, because it arrives in the order 
that It had aesn gsnarated by whatever equipment ra-ealed *e data that had been applied to buffer 220 In the Iransmit- 
Eer. B tf^e error correction codes are to be utilised, then ttie data must first be evaluated whether a transmissioo error 
occurred. ConcsptuaHy, ihe deccKling can be dorte essenbc^ly in the very same marsner as the error correct!r>g symbcSs 

s were generated In the tfansmitier of FIGS. 10-12. That is, the data can be roLrted to a coilectton of RS decoders, error 
corectmQ symfcds tart be generated and then used to evaiuate the need to correct symtofs that arrive from the trans- 
mitter Thereafs-sr, additoriai processing must be carried out to correct errors, if any. artd tinaliy, the corrected data can 
be deliver 6KJ to its u!iinr«te Lser. That means, of course, that the arrMt^g data must be delayed (and mairrtalned) prior 
to its delivery to the ultimate user untit the error ccrreclion processing Is accomplished; ergo, a merriory is needed. More 

fo specifically, the amount oJ memory needed is equal to that which is siiflicrent to store the eritire codeword, and to store 
newiy arriving i^formatiof^ white the codew.'ord is ei/aluated and corrected. 

in the arrangement o! FIG, 7, iof example, the isiptied interleaving is aocH interleaving and the evaSuaSion and cor- 
rection cannot Stan until ail data ts in (at the, end of the i tth row in FIG. 7). The evaluation of eli S codeiivofds starts in 
the "i 2th row, HPid all S ccsdewords must, then, be evaiuatetS cortixtrrently. !f tt>e equipfvient «iat can eva!iiate and correct 

;s the 5 codeworcfe takes, for example, 6 symbols pesiods par codeword, or 30 symbol periods, then tfie total rnemafy 
reqiiired is 65 synrfcois to store the 5 codewords artd 30 syrrtojjs to store She incoming data during the con-ecbon phase: 
for 8 total of 95 syrrtixtis, or 0(N+L), where L Is the nurrcber of symbols necessity to correct a codeworc!. {fi& m aside, 
the element that canrses Cfut the calculations necessary to correct transjnissiori errors is not lirTwted to operating at She 
symixji rate of tfie incoming data and, typically, such an element, e.g. a microprocessor, can operate at speeds that are 

sa far higher than the symbol rate of the data.) 

In the aiTar^gsmem of FIG. 8, on the other hand, the codewords do not begin and end a1 lha same time and, there- 
fore, the codeword evaluatioris and corrections also do not need to occur concurrently. Specifically, in !he FIG. 8 
arra-igament there are 13 cells frorn the end of one codeword So tfie end oS the neart codeword, arsd 5 ceils from the time 
th» last redundant sjfmbol of s f»rtictilar codewo«S arrives <s,g.. the codeword in cc5umn 1 of the FIG. 8 matrix) and the 
. ss first syrriw! of *ie next ir^carnatioo of that codeword arrives. Since >t takes only S symbol perio<is to correct a code-rord 
(with equlpmen? issed in the abopi/e eotampte). it follows tfest one syrtfeoS of adcSttonal memory is required. Hence, the 
totaS memory requtred in the receiver for the FIG. 8 arrangement is S6 symtjols. On the other fiand, with a faster proc- 
esses- that requires only 5 symt>ol periods to correct a codeword, only 65 symbols of memory would be require - which 
Is ths minimum memory necessary. One can think of the memory recjuirement as N*D, plus L-D, with the nUnimum being 

30 KD, 

FIG. 1 3 presents a block diagram of still another embodiment that Is adapted 1o the principles of this invention. Just 
as with the arrangement of FSG, 1 1 , it can sefve as an encoder (within a transmitteri, or as a decoder (within a receiver) . 
It includes a merrK-ry 310, a processor 320 coupl«J to merriory 310 and a controller 330 coupled to memory 310 arid 
processor 320. .^depicted, memory 310 ir^ciudes a number of data ports (input, ou^ut lo user and otrtput to processor 

3S 320) biJt in actu3!it>', a single IfO port is time shared. When acting as a receiver, processor 320 r e^s data from memory 
310 ar>d analyies that data. M correction of da la syrrfeds is oalled tor, processor 320 writes cfeita into memc-ry 310, 

Processor 320 cames oi!t the processing necessary for detecting errors and for correcting errors. Some merrvory 
is needed to store temporary results of me error detection processes, and that memory may be included within control- 
ler 330 or be part msmory 310. A program store memory will, ol course, provide ttie necessary storage area. That 

40 memory aiso holds Ihe prt^rams that control processor 320. 

The error conectior^ pvocessInQ method thss processor 320 carries out is not described fiere because it may be per- 
fectiy convsnttonai and forms no f»art ot this invention. Whatever coding schema Is seSected (be it Reed -Solomon, or 
other coding), the corresponding decoding nrust be applied by processor 320. What is unitjue in both the transmitter 
and She receiver arrangsments is the utter fiexibi;;ty to barsdis whatever Implied interleaving is seSetSed, and the sirj^llc- 

iis ity of the attendant co.Tirois. Thus, for escarr^pls, for the interleaving arrangemerst sJiown in FIG, 8 and the FIG, 13 
arrangement t;sed as & receiver, when the controller focus is on eel! 1 (first row, first cdurrai) the following acSvilies take 
p^ace; 

A1. memory 310 outpijts the symbol stored for codeuwrd 1 in call 1 (which had already bean corrected, if neces- 
so sary) and delivers H to the user: 

A2 the erfor detection temporary store tor codeword 1 (in controiles 330) is reset: 

A3, the symbO! arriving at the receiver is declared to be the first syrvUxil of the n&xX codeword i and is stored in ceil 

n 

A4, the error detection information in the temporaty store for codeword 1 ss updated wifli the infornnation stored in 
ss cell 1 : and 

AS. the error correction processing for codewotd 2 is Inhjated. 

When the contfi^ier focus fe on cell 2, the toilowing activities take pace: 
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ai . frsemory 310 ouSpots »ie symbol stored for codeword 3 in eel! 2 artd delivers i! to the user; 
S2, !he symbol as riving at the receirer is declared to be me next syrnbal of codewosri 3 and it is stored in cs!i 2: 
B3, -he error detecttor; snformation in the temporary store ior codeword 3 is updaied me information ssored in 
ceii 2; and 

5 B4 . the error conrsctkan processing for codeword S is continued. 

By Itie time fa«js rests on ceii 1 3. the error correction processing of codewofti 2 is completed, allowing ceil 1 4 to Oulpu! 
the correct first syn*£>i of codeword S; whereijpon process st^s A1 through A5, abwe. can be exscuted. 

To den^nstrate trie fSexibslity of the arrangerriefTt disctosed herein, an eattension io product encoding is presenJed. 

so By 'pnoducr what is rrsaarst. is that the innpiied intterieavins cars be viewed to bs two cSmensional. as illustrated, for sonam- 
ple, in riG, 14 virtiich sncitjdes an impHed convolutional interleaying arrangennerrt in accord with FtG. S (column-iwise), 
Mfltti art frr^^iec bSocK interfeswing row-wise. Since ttiose error correcting synrsbds loiicfw ttie data as it arrived (where 
cetts ara filled a row st a time), the modification to ihe transmitter ts mereiy one addiSona! encoder in parallel with the 
encodsr bank iliustJaJed. for exarr^le, in FIG, 10. Specificaftsf, m sfiown in FIG. 15. the transmitter includes an adcS- 

is tioriai BTscoder 125 ss^ose output is delivered to channel 10 under control of muftipiexer 221. The FtG. 15 SKtertsion to 
the FiG. 10 arrangeimsnl is msre-V illustrative, of coitfse. The other architectures, such as that of FiG. 13. are simiiarty 
eKter(dib;0. 

At the receiver, wf-en ftjci® is os-s the row error correding symbol. She iriforrfiatson is available to perform wtiafever 
procedure is necessary within processor 320. The erroneous symboljs) in the row can then be corrected, or information 

£•0 about those symbofs can be stored and taken into account when the codeword error correction process is ©cecuted. 
For exsfrpie, with a single parity in each row, a single error in the row cari be idsrnifisd That inforrrtatton can b© com- 
municated to eacl-i o5 the codeword correction procedures, and that intormation can simplify those procedures. For 
eKanpie. knowledge tfiat an error exists in row 4 of FIG, 8 corresponds to knowledge that an error may exist in symbol 
4 of codewonJ 1 , in symbol 12 of codeword 3 (the first reduridanl symbol ire codeword 3). in symbol 7 of codeword S. in 

ss syn-ftwai 2 of codeword 2. w in synnSxJt 1 0 of codeword 4. 

The above discussiori rsgarcSng corwolutional tmerleaving depicted the oonventiOfist condition of regular conwdu- 
tion^ interleaving where every (0+1)* symbol ijelongs to a particular codeword. That is not a requirement, however. 
Indeed, -me encoder/decoder of. for ejtartipie. FIG. 13 can handle a random arrangesnert that does not fbiiov« ftie above 
notion. FSG. 1 6 iilustrstss such an irrpiied convolutionai ir»terlea',flng where every (D+l )*" 6yrt*>ols does mt neeessarity 

$0 belong to a particulaf codeword. In contradistindion to regul^ convdiitionai interleaving, this may be considered 
random coiwoiufionaS irterleaving. Even a higher level of "Vafjdomrress" Is acceptafcJe in, for example, abandoning the 
notion of consectjtive s;ymbals a,'e roiled fo different encoders. That, in feet, is not a requirement, arsf orie can easily 
devise arrangements where ali, or some, of the encoders have a pair of consecutive sym^x;-;s routed to them. The max- 
irrsjm ntimber of consecutive symbols is, of course, the number of symbols in a codeword, and that, otefiously, is the 
limrt (yielding a tion-imerteat^ed arsangement). 

Claims 

1. An encoder incfucJing a menxiry (310), and processing means (320) coupled to the memory ii-sctuding means (330) 
m tor ^sTiting Incoming symbols into the memory, means (330} for riding symbols out of the memory at rale higher 
than the rate of writing into ma memory and applying tt!e *ead symbols toa channel, means (330) for implementing 
0 encoders (D being an irrte^er) in cooperafton with the prooessirjg rrreans and the memory by em^rfoying the read 
symbols io calculations aimed at developing redutxlant s>ymJ>ois, where each set of O cor^era/tive symbols are dis- 
tributed lo diffarer?! ones of the implemented D erscodere, a-nd means (330) for apf^ying the redurvdant syrt^ols to 
ts the channel, 

cterscterixed ies thet 

the calculations for she O encoders are reset in accordance with a selected implied convolutionai interlsaving 
schema. 

iTO 2. An encoder atxofding to clai.m 1 where, under control of the processing means, in addition to each set of D con- 
secutive sifmbols beir^g distfibuted to diffeien! ones of the imptememed D erwoders, each (D+i)'-'" symbol is 
etr^oyed in (he csiasiations of a particular ericoder. 

3. An errcoder accordincj to claim 1 wfiere, under control of the processing means, in addition to earti set of O con- 
S5 seciiSve symbols t--^:-;;^ distrirMsfscl fo di^srss-f* on?;?; oS the implemented D encoders, at least one set that contains 

«iach (D+i)'^ sytntxi! is errp-oyed In the calculations of nare than one encoder, 

4. An encoder acco.'ding to claim 1 where inctariing symbols are written inio a data buffering region of the memory. 
synr!bais are read out of the data buffering region, and incite mentation of the D encoders involves storage of calcu- 
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iaSton resijits. which resutts am stored in antrther refgion of the m®nory, 

S. TJ-18 encoder o?" ciaim 1 where the reading oiJt oi symbols out of the memory is in the same order ss symbois written 
into the meTOfy. 

s 

S. The encoder of ciaim 1 further camprising means for block ersoodtng said incoming signals. 

7. The encoder of claim 6 whsrein said block interlesving and said convolutional interiesving form a product encoding 
arrangenrsent 

?c 

8. Ast impliad interleai/ing encoder res^jonsive to & stream ot incoming data symbcrfs that is assumed to comprise 
codewords havirsg N symbo's which include redundant symtwis and which are interleaved in a convoJutionsI inter- 
leaving pattern so an irit^leavins aepm O, Sir developing the fedunciant symbois for each of she codswonjs si'k! 
inserting them in She stream ct incorrting data symtKjIs in accordartce wilh !tie injerieaving pattern, including a pSu- 

is mty of D encoders (223), each of which cfsvelops a set of at least one redundant syntxit corresponding to a 
sequence of syjribols shat define « data portion of & codeword, a first router <222), r^aonsave fo incomme data for 
delivering successive symbols eo different ones of the D enoodeis in cyclic manner, and a ccwribinef (226, 221). 
responsive Jo t^-is redundant symbois developed by the D encoders end to outfit data of ftie first memory, for'appSy- 
ing information arriving at the combiner to a channel, chs)-act«r)a:e<$ In thst 

so saoh of tne D encoders is arranged handle code-words Shat are offset from the codawonds handled by the 

oth er encoders by at ieasi two syrrtoote. 

9. A method for encoding and intsfiaawing an applied sequence of input sigtmls arriving at regular intervals, the 
sequence having a given order, to develop an interleaved output signal comprising the input signals in a sequence 

■zs having the same given order, the metfiod comprising the sSepsof: 

routing ttie input signals to a plurality of encoders; 

in response to the input signals routed to the encoders, the encoders developing a selecEed number of redu.f^- 
dant signais and ou^utb.ng the redundant signals, where the inserting of redundant signals by any one of the 
30 enojders is staggered in time relative to any other orte of the encoders by more than one of said intervals; and 

routing the oatpjil signais of tSie encoders to m oulput porS. 

10. A decodsif res^sonsive to an incoming stream of data tMat includes codeword that are N symbols long w/hich are 
interleaved to a -iepf^s D. where eadi codeword includes infortmtion symbols ancj redundant symbcrfs, comprising: 

a processor (320) for correcting errors found in said codewords; 

s storage device {310), coupied to said incoming stream of data and to said processor, having merrKiry aito- 
cated tor stctring D{L+Ni symbols, where L is the number of symtwls amving at the decoder during the time 
needed by the processor to con-ect errors found in one codeword; and 
40 a controller (330) for conirofSing said processor as well as input and output of data to and from the memory 

Where 

errors !o be conected are corrected by the processor by ovenwiiing corrupted symbols with corrected 
symbols, arid 

symtKiis; of the incoming data are stored in ihe memory arid the ir^formaticn symbols are delivered to a 
•IS user port, from the metT^ory, corrected as necessary, in the same order that the data arrived. 

1 1 . The decoder of c-aim "SO where the mierieaving of the incoming stream of data is convoJutionaf interleaving. 

12. The decoder oi claim 11 and the memory contains at most ND symbols ol memory devoted to storing incoming 
50 data. 
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